Three detailed fluctuation theorems 
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The total entropy production ol a trajectory can be split into an adiabatic and a non-adiabatic 
contribution, deriving respectively from the breaking of detailed balance via nonequilibrium bound- 
ary conditions or by external driving. We show that each of them, the total, the adiabatic and the 
non-adiabatic trajectory entropy, separately satisfies a detailed fluctuation theorem. 
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Small systems are subject to fluctuations. As a re- 
sult, the energy Q that such a system absorbs from its 
surrounding reservoir during a given time interval will 
be a random variable, functional of the specific trajec- 
tory followed by the state of the system in the mean- 
time. If the reservoir can be regarded as an idealized 
thermal reservoir, remaining all the time at equilibrium 
at a given temperature (we set ks = 1), one con- 
cludes that the change in its entropy AS r = — f3Q is 
also a random variable. Such trajectory entropy has to 
be distinguished from its ensemble average (A5 r ) cor- 
responding to the conventional thermodynamic entropy. 
In thcrmostated [l[ and stochastic systems [H, it was 
shown that the probability distribution of AS r obeys a 
asymptotic detailed fluctuation theorem (FT) of the form 
P(AS r )/P(-AS r ) ~ exp(ASV). The result was derived 
under steady state conditions for a system with bounded 
energy and in the limit of a large time interval. It was 
subsequently realized [J] that this asymptotic FT re- 
sulted from a detailed FT for the total entropy AStot, ob- 
tained by adding the system entropy AS to the reservoir 
entropy AS r , valid for all times and for any initial condi- 
tion, P{AS to t)/P{- AStot) = eMAStot). The overbar 
tilde refers to the fact that in presence of an external 
driving, the time-reversed driving has to be considered. 
It implies an integral FT, namely (exp(— AStot)) = h 
leading in its turn to (AStot) > 0, in agreement with 
the second law of thermodynamics. The asymptotic 
FT follows in long time limit when AS is bounded and 
AS r ~ t becomes dominant. For systems with non- 
bounded energy the steady state FT can be broken 
In case of an externally driven system initially at (canoni- 
cal) equilibrium with temperature /3 _1 , the total entropy 
production can be expressed as AS to t — fi{W — AF) 
where W denotes the work performed on the system 
and AF is the free energy difference of the system be- 
tween its final and initial equilibrium states. The detailed 
FT thus becomes the Crooks relation P(W)/P(—W) = 
exp[{3(W — AF)] and its integrated version, the Jarzyn- 
ski equality (exp(- j3W)) = exp(-/3AF). Both FTs have 



been derived for stochastic as well as microscopic dynam- 
ics 0, @ with the assumption of weak coupling between 
system and reservoir (see however also 0])- Other FTs 
have been derived. The integral (detailed) Hatano-Sasa 
FT [I, i] (0) for the quantity /3Q ex - AS is a gener- 
alization of the Jarzynski (Crooks) relation to situations 
where the system starts and ends in a nonequilibrium 
steady state. Q ex is called the excess heat. We finally 
mention the Speck-Seifert integral FT for the so-called 
housekeeping heat Q hk = Q - Q ex (il. [ill]. 

The work and FT discussed above basically extend the 
pioneering ideas of Onsager on the implications of micro- 
reversibility to (small) nonequilibrium systems. Their 
application and experimental verification have been the 
object of several reviews @, [H, 13 1. Nevertheless, there 
is still some confusion in the literature due to the var- 
ious forms of the FTs and the conditions under which 
they apply. The purpose of this letter is to clarify the 
situation with the derivation of three basic FTs. One 
of them is the "standard" theorem for the total entropy 
production AStot- The aforementioned natural separa- 
tion into a reservoir contribution AS r and system con- 
tribution AS suffers from the deficiency that these quan- 
tities themselves do not obey a FT. As we proceed to 
show there is however another separation of the total 
entropy, AS to t = AS na + AS a , where the so-called non- 
adiabatic AS na and adiabatic component AS a satisfy, 
each separately, a detailed and integral FT. These con- 
tributions have a physical meaning as they correspond to 
two basic ways in which a system can be brought out of 
equilibrium, namely by driving the system by a time de- 
pendent force or by applying steady nonequilibrium con- 
straints. Furthermore, in the case of a single heat reser- 
voir AS a — —ftQhk and if in addition only transitions 
between steady states are considered AS na = AS — PQ ex 
14j . Under these conditions, the aforementioned corre- 



sponding FTs are in fact FTs for AS a and AS na . 

Before embarking on the general derivation of the FTs 
for total entropy, and its adiabatic and non-adiabatic 
contributions, we make a number of revealing mathemat- 



2 



ical statements which will clarify and simplify the subse- 
quent discussion, and which streamlines the derivation of 
FTs. A random variable R, with probability distribution 
P(R), is said to obey an integral FT if: 



(e- R ) = J dRP(R)e- R = 1. 



(1) 



By Jensen's inequality, we then also find that (R) > 
[average with respect to P(R)}. An alternative for- 
mulation of (Q} is to state that the positive quantity 
P(R) = P(—R)e R is a normalized probability distribu- 
tion. We conclude that when a variable obeys an integral 
FT, it automatically obeys a detailed FT, i.e., there ex- 
ists a probability distribution P of R such that: 



P(R) 

P(-R) 



VR. 



(2) 



The previously discussed entropy-related FTs are of the 
above form with R playing the role of the total trajectory 
entropy production, and with the additional feature that 
the distribution P(R) is simply related to the original 
distribution P(R) as P(R) = P(R) or P(R) = P(R). 

We next present a recipe to generate a variable obeying 
a FT. We make the observation that the relative entropy 
or Kullback-Leibler distance between two probability dis- 
tributions V m and V m of a (set of) random variable(s) 
m is: 



,„ ' III 



(3) 



The variables m correspond here to the trajectories fol- 
lowed by the system during a given time interval. V and 
V denote normalized probability densities of these trajec- 
tories. Performing the sum over m is used as a compact 
notation for a path integral over these trajectories. For a 
single realization of a trajectory, the quantity of interest 
is thus the variable r m : 



in 5 

Vn 



(4) 



We now consider the probability distribution of this vari- 
able, when m is sampled according to V m . The resulting 
random variable R is characterized by the probability 
distribution 



P(R) = ^8(R-r m )V n 

m 

One verifies that it obeys the FT ([I]): 



dRP{R)e~ 



(5) 



(G) 



We now assume that V m can be obtained via a mathe- 
matical "tilde" operation from V m which is an involution: 



As a result, we find that 



In 



(8) 



which implies that the probability distribution P(R) can 
be written as follows: 

P(R) = P(-R)c R = Y, 5 ( R + r m )V m e-^ 

m 

= J2 5 ( R - ( 9 ) 

rn 

and justifies a-posteriori the use of the same superscript 
tilde for both distributions P(R) and T m . 

To apply the above mathematical observations to the 
problem of entropy production in a driven nonequilib- 
rium physical system, we need to introduce a physical 
model for the dynamics of the system. For simplicity and 
clarity of presentation, we restrict ourselves here to the 
case of Markovian dynamics on a set of discrete states m. 
The transition probability per unit time from state ml to 
to via a mechanism v will be denoted by Wj? ,(\t). The 
latter generally depend on time, via a control variable 
Xt which describes external driving. After introducing 
the compact notation W m , m '(A t ) = J2 u ^m,m'(^t), the 
probability p m (t) to be in state to at time t obeys the 
following Master equation: 



Pm(t) = ^ W m ,m' {h)Pm> (*)• 



(10) 



Consistent with the notation used earlier, we introduce 
the probability P m for a trajectory m = {m t , t £ [0, T]}, 
obeying the Markovian stochastic dynamics ([TO]) . Note 
that V m depends implicitly on the applied schedule A = 
{X t ,t G [0,T]} of the control variable and on the proba- 
bility p mo (0) of its initial state rn - To obtain an explicit 
expression for V m , we note that a trajectory is described 
by its initial condition mo, the times tj at which is un- 
dergoes changes in its state from rrij-i (state prior to 
jump) to rrij (state after jump) and the type Vj of this 
transition, with the index j running over the total num- 
ber N of jumps of the specified trajectory. We use tq = 
and Tjv+i = T. We can thus write: 

N 

Vm = Pm M[\{^ dT ' Wm ^- l(K ' ) (11) 



e f? N dr'W mN , mN (\ T ,) 



(7) 



In the sequel, we will again use an overbar for the time- 
reversed quantities: m stands for the time-reversed tra- 
jectory of m, A for time reversed control schedule of A 
(i.e. A t = At-*), and P m for the probability of the time- 
reversed trajectory m (the initial condition of m being 
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obviously the final state of m, appearing with proba- 
bility p mN (T)), with time- reversed driving A. Explicitly: 



N 



£~ T] dr'W m . m (A .) 



T "]Pm N (T) 



(12) 



To make the connection with entropy production, we 
start from the following expression for the total trajec- 
tory entropy production, obtained from both stochastic 
and microscopic analysis 0, 0, [HI 14, 16j|: 



AS tot [m} = In 



(13) 



Inserting the above explicit formula of V m in terms of 
the trajectories, one finds that, upon taking the ratio 
Vxa/Vm, only the contributions of the jumps in the state 
of the system survive, together with a contribution in the 
change of probability of initial versus final state: 



AS tot [m]=ln — -— - + ^ln — _ __. (14) 

Pm N {J-) J = l Wmj-iwiKj) 

The total trajectory entropy is thus given as a sum, 
A5t t[m] = A5[m] + A5 r [m], with the first term in the 
r.h.s., A5[m] = - lnp mjv (T)- (- lnp mo (0)), correspond- 
ing to the change in trajectory system entropy, and the 
second, ASV[m], being the change in trajectory reservoir 
entropy along the specified trajectory. 

To proceed, we introduce the instantaneous station- 
ary distribution pf^(X t ), which is the steady state that 
is reached when the transition probabilities are frozen in 
time to the value W mtm '(Xt)- They correspond to the 
normalized zero right eigenvector of this transition ma- 
trix: 



^WW(A t )?e(A t ) = 0. 



(15) 



The total trajectory entropy (I14[) can now be split in the 
following alternative way: 

AS tot [m] = AS na [m] + AS a [m] (16) 

with the non-adiabatic trajectory entropy: 



A5 na [m] = In 



Pm (0) 



N 



Pm N 



, (17) 



and the adiabatic contribution: 

AS a m = > In j— 3 - . 



(18) 



We first note that this separation is relevant if the sys- 
tem steady state does not satisfy detailed balance, else 



the argument of the logarithm in (fl8)) equal one and 
AS a — 0. The name given to these two contributions 
can be justified as follows. Suppose that the relaxation 
of the stochastic dynamics is very fast compared to the 
timescale of the schedule A*. During such a so-called adi- 
abatic process, the probability distribution will assume 
at all times the instantaneous steady state form pf^(X t ) 
and it can be verified that this implies (AS na ) — and 
thus (AStot) — (AS a )- When such a timescale separation 
does not exist, (AS na ) ^ and it is therefore natural to 
refer to it as the non-adiabatic contribution. 

The total trajectory entropy (fT3|) is the logarithm of 
the ratio of trajectory probabilities. We now show that 
the adiabatic and non-adiabatic entropy productions can 
also be written under such a form by introducing the 
Markov process that is obtained from the original one, 
with transition matrix W^(Xt), by considering the ad- 
joint transition matrix W^ + (Xt) (also called dual or 
reversal [1, given by: 



W {v) +(X t ) 



w. 



.(At)p£(A t ) 



(19) 



This Markov process has the same instantaneous steady 
states as the original one. W + coincides with W only 
under the condition that detailed balance is satisfied 
with respect to the instantaneous stationary distribution 
Pm(^t)- We will use the notation for the probabil- 
ities of trajectories that are generated by the Markov 
processes associated to W + (X t ) and denotes the 
probabilities of time reversed trajectories generated with 
the adjoint rate matrix with time reversed driving, i.e. 
W+{X T -t). 

The main point in the derivation of the FTs is to note 
that the non-adiabatic and adiabatic entropy production 
contributions are again given in terms of the logarithm 
of the ratio of trajectory probabilities: 

AS na [m] = hi2^ , AS [m] = ln^ (20) 

r in r m 

This can be verified by inspection, using (ITT|) and (fT2")) 
with the appropriate transition probabilities for the tra- 
jectory probabilities. In particular the diagonal ele- 
ments of W + and W are identical, so that again only 
contributions from jumps and initial conditions appear. 
The expression for the non-adiabatic trajectory entropy 
change AS na is similar to that for total trajectory en- 
tropy AStot, since they both feature the ratio of a forward 
and time-reversed path. In both cases, the time-reversed 
path starts with the final probability distribution of the 
forward evolution, but determined respectively by the 
(time-reversed) transition matrix W(A) and by the ad- 
joint (time- reversed) transition matrix W + (X). The adi- 
abatic trajectory entropy change AS a on the other hand 
is given in terms of the ratio of trajectory probabilities 
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with same initial condition and same driving, but de- 
scribed by the "forward" transition matrix W and the 
adjoint transition matrix W + , respectively. It vanishes 
when W+ = W. 

The trajectory entropies (fT5|) and (|20p have the struc- 
ture of the random variable r m , cf. Hence they 
satisfy a (detailed and integral) FT when they are sam- 
pled with the "forward" probability V m . We further- 
more identify P m — Vfa f° r the total trajectory entropy 
production, P m = for its non-adiabatic contribution 
and P m = for its adiabatic one. It is obvious that 
the involution condition (JT)) is satisfied for all of them. 
From j8]), we thus find that f m is given by — AS tot [m], 
-AS na [m] and -AS n [m] for total, non-adiabatic and 
adiabatic trajectory entropy, respectively. We conclude 
from © and © that the following three detailed FT 
hold: 



P(AS tot ) 

P(-AStot) 



,AS io 



P(AS na ) 
P+(-AS na 



P(AS a ) 
P+(-AS a ) 



„AS„ 



(21) 
(22) 



As a by-product, we also note that each average en- 
tropy can be expressed as a relative entropy of the form 
©, namely (AS tot ) = D(V m \\P^) > 0, (AS na ) = 
D(P m \\P£) > 0, and (AS a ) = D(V m \\P+) > 0. This 
identification for the total entropy production has been 
done for both stochastic (IBj and microscopic dynamics 

We close with additional comments. First, we 
mentioned that the FTs are a consequence of micro- 
reversibility (and Liouville's theorem). This is not imme- 
diately apparent in the above derivation. However, these 
fundamental properties of micro-dynamics are needed to 
identify (fTo| as the correct expression for the total trajec- 
tory entropy 17|. In particular, equilibrium corresponds 
to the absence of an arrow of time, V m — P^, and is 
thus equivalent with AS' tot [m] = 0. Second, the above 
derived FTs also apply to the case of (driven) Langevin 
or Fokker-Planck dynamics, since these can be obtained 
in the appropriate limit from Master Equation dynam- 
ics. This procedure allows to make the connection with 
related results obtained at the level of the Langevin equa- 
tion HQS EH- Theresults 

can also be extended to the 
case of particle transport between system and reservoirs. 
Third, the experimental measurement of the adiabatic 
and non-adiabatic trajectory entropy should not pose 
any problems, since ratios of trajectory probabilities have 
been measured before [HI . Finally, the fact that two con- 
stitutive parts of the entropy production have separately 
properties identical to that of the total entropy, suggests 
that implications of the fluctuation theorem (e.g., On- 
sager symmetry) and of the second law itself (e.g., pre- 
dictions on efficiency of thermal machines), can be un- 



ravelled into an adiabatic and non-adiabatic component. 
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